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Abstract 



We consider semi-infinite linear programs with countably many constraints 
indexed by the natural numbers. When the constraint space is the vector 
space of all real valued sequences, we show the finite support (Haar) dual 
is equivalent to the algebraic Lagrangian dual of the linear program. This 
settles a question left open by Anderson and Nash [2|. This result implies 
that if there is a duality gap between the primal linear program and its 
finite support dual, then this duality gap cannot be closed by considering 
>• ! the larger space of dual variables that define the algebraic Lagrangian dual. 

However, if the constraint space corresponds to certain subspaces of all real- 
valued sequences, there may be a strictly positive duality gap with the finite 
support dual, but a zero duality gap with the algebraic Lagrangian dual. 

q ! Keywords: semi-infinite linear programs, finite support duals, duality gaps 
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1. Introduction 

We begin with a brief review of notation and basic definitions for semi- 
infinite linear programs. Let Y be a vector space. The algebraic dual of Y 
is the set of linear functionals with domain Y and is denoted by Y'. Let 
if) G Y' . The evaluation of if) at y is denoted by (y, if)); that is, (y, if)) = if)(y). 

Let P be a convex cone in Y. A convex cone P is pointed if and only if 
P n —P = {0}. In the rest of the paper all convex cones are assumed to be 
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pointed. A pointed convex cone P in Y defines a vector space ordering ^p 
of Y, with y ^p y' if y — y' G P. The dwa/ cone of P is 

P' = {^ G F' : (y, ^) > for all y G P} . 

Elements of P' are called positive linear Junctionals on Y. Let A : X — > Y 
be a linear mapping from vector space X to vector space Y. The algebraic 
adjoint A' : Y' — )■ X' is a linear operator defined by A'(ip) = ipoA and satisfies 
(x, A'{ip)) = (A(x),ip) where ip G Y' and x G X. Using this notation, define 
the primal conic optimization problem 

inf -f <?'*> . (ConLP) 

s.t. A(x) ^ P 6 v ; 

where 6 G K and is a linear functional on X. 

Now define the standard algebraic Lagrangian dual for (IConLPp . 

sup inf {(x,(f)) + (b-A(x),ip)} = sup inf {(x, (p) + {b, ip) - (A(x),ip)\ 

= sup { (b, ij>) + inf {(x, <P) - (A(x), V>}}} 
ipeP' x ^ x 

= sup {(&,</>) + inf {(x,0) - foA'ty))}} 
i/)eP' x&x 

= sup {(&,V) + M(x,<t>-A'(iP))}. 
■4>eP' xeX 

Since x G X is unrestricted, if (p—A'(ip) is not the zero linear functional on X, 
then the inner minimization goes to negative infinity, so require <p — A'(ip) = 
8x, where 9x is the zero linear functional on X. Then the Lagrangian dual 
of ( IConLPp is 



sup (b, ip) 

s.t. A'{ip) = <p (ConDLP) 

i eP'. 



This problem is called the algebraic Lagrangian dual of (ISILPp since the 



linear functionals ip that define the dual problem are in Y', which is the 
algebraic dual of Y. 

Semi-infinite linear programs. Consider the case where X = M n and Y = M. 1 , 
i.e., the vector space of real- valued functions with domain / where / is an 



arbitrary (potentially infinite) set. Let a 1 , a 2 , . . . , a n and b be functions in 
Y = M 7 . Let A : W 1 — > M 7 be the linear mapping x h- > (a}(i)xi + a 2 (i)x 2 + 
. . . + a n {i)x n : i G I). Let M+ denote the pointed cone of u G M 7 such that 
u(i) > for alH G / and let P = M+. With this specification for the vector 
spaces X and Y, the map A, right hand side b and cone P, problem (IConLPj) 
reduces to the standard semi-infinite linear program 

infxGK n X /OTT p\ 

s -t- ELi a k (i>k > b(i) for all i G /. { ' 

There is a slight abuse of notation here. When X = M n , the algebraic dual 
X' is isomorphic to W 1 so each linear functional <fi G X' can be mapped to 
a vector in W 1 . Thus, the primal objective function (x,(/>) in (IConLPp . is 
replaced by the inner product <j) T x with <p now treated as a vector in M n . 
Next consider two alternative duals of (ISILPj) : the algebraic Lagrangian 



dual and the finite support dual due to Haar [3j. Recall that (K.+)' de- 
notes the dual cone of P = M.+. The algebraic Lagrangian dual of (ISILPj) 
using (IConDLPj) is 



sup 


{b,W 




s.t. 


A' (if) 


= 




i/> 


G 



(DSILP) 



A second dual is derived as follows. Instead of considering every linear 
functional ip G (K.+)' as above, consider a subset of these linear functionals, 
called the finite support elements. For u G M. 1 , the support of u is the set 
supp(w) = {i : u(i) 7^ 0}. The subspace W^ denotes those functions in M 7 
with finite support. Let M, + denote the pointed cone of v G M.^ such that 
v(i) > for all i G /. Under the standard embedding of M'- 7 - 1 into (R 1 )' for 
u G M 7 and t> G M*- 7 - 1 , write (it, t> ) = ^i£ju(i)v(i). The latter sum is well- 
defined since v has finite support. Under this embedding, M. + is a subset of 
(1R+)'. Moreover, under this embedding, A' : (IR 7 )' — > X'(= W 1 ) restricted to 
W.W becomes the map A'(v) = (^2 ieI a k {i)v{i))1 =1 . The finite support dual 
is 



sup 


£iei&(*M*) 




s.t. 


l^iei 


a k (i)v(i) 


= 4>k, 






V 


gm! 7) 



n 



(FDSILP) 



The finite support dual (IFDSILPp is restricted to the linear functional 
ip that can be mapped to v e M. + under the standard embedding of R'- 7 -' 
into (1R 7 ) . Therefore v (IFDSILPp < v (IDSILPI) where the optimal value of 
optimization problem (*) is denoted by v(*). This leads naturally to the 
following question. 

Question 1. Is it possible that v tETHB = ^ (IDSILPp and u<J5IEEJ > IFDSILPp ? 
In other words, can there exist a duality gap between the primal and its finite 
support dual that is closed by considering the algebraic Lagrangian dual? 

This question is significant for the study of semi-infinite linear program- 
ming since: (i) nearly all theory has been developed for the finite support 
dual, and (ii) the algebraic Lagrangian dual is notoriously challenging to 
characterize and work with. 

To the authors' knowledge this question has not been settled for I = N, 
i.e., semi-infinite linear programs with countably many constraints. Indeed, 
on page 66 of Anderson and Nash's seminal work [2| they write: "It seems 
to be hard, if not impossible, to find examples of countable semi-infinite 
programs which have a duality gap in this formulation [the finite support 
dual], but have no duality gap when we take W to be a wider class of se- 
quences" where W refers to the vector space of dual variables. In our nota- 
tion, W = (M N )' in fIDSILPp and W = M (N) in (IFDSILPp . The main result 



of this paper (Theorem 12.21) is to prove that this is indeed impossible, and 
therefore answer Question [T] negatively for the case of I = N. We show that 
^ (IDSILPI) = IFDSILPp by establishing that (IDSILPp and (IFDSILPp are 
equivalent. 

However, there is a subtlety in Question[T]to keep in mind for semi-infinite 
linear programs with countably many constraints. In the above discussion, 
a semi-infinite linear program with countably many constraints was cast as 
an instance of (IConLPD with X = R", Y = M N , A : X -»■ Y defined by 
A(x) = (a l {i)x 1 + a 2 {i)x 2 + . . . + a n (i)x n lie I), and P = R®. Then (IDSILPD 



was formed using (IConDLPp . However, if the vectors a 1 ,^,...,^ and b 



lie in a subspace V C R N , then we may use Y = V and P = V fl M^ 
to write the semi- infinite linear program as an instance of (IConLPI) . The 
corresponding (IConDLPp is 



sup (b, ip) 

s.t. A' (if)) =<p (DSILP(V)) 

i> 6(VnR5)' 



where (V D R*)' C V is the dual cone of P = V n Rj, which lies in the 
algebraic dual of V. 

It is quite possible that a positive linear functional defined on (V D R+)' 
cannot be extended to (R+)'. This implies fIDSILPj) (with I = N) may have 



a smaller value than (]DSILP(V)[), i.e., ^ (IDSILPp < i;(]DSILP(V)[). In this 



context, the following question is a natural extension of Question [TJ 



Question 2. Is it possible that u rtSILTl) = t;( |DSILP(V)[ ) and v( ETLP\ > 
f flFDSILPp = ^ (jDSILPp when a 1 , . . . , a n , b G V for some subspace V C R N ? 



In other words, when the primal constraint space lies in a subspace of R N , 
can there exist a duality gap between the primal and its finite support dual 
(IFDSILPj) . that is closed by considering the algebraic Lagrangian dual defined 
according to that subspace? 

We show in Section [3] that this can happen. More concretely, in Exam- 
ple 13.51 in Section [31 there is a duality gap between (SILP) and the finite 
support dual fIFDSILPI) . However, if a 1 , . . . , a n , b are considered as elements 



of the space of convergent real sequences c, then fISILPp is a special case 
of (IConLPp with X = R n , V = Y = c, A : X -> Y and P = c+ (the cone 
of sequences with nonnegative entries) , and there is no duality gap with its 



algebraic Lagrangian dual (DSILP(c)) 



3Up 


(M) 




S.t. 


A'W) 


— 




i> 


e 



4> (DSILP(c)) 

where d is the algebraic dual vector space of c. The same result also holds 
when Y is the subspace of bounded real sequences (ioo. 

2. Main result 

Lemma 2.1. For every ip e (R+)', there exists u G R+ such that (y,ip) = 
^jgN2/(^) M (^) f° r every y e R N . In other words, every positive linear func- 
tional on R N can be represented by a positive finite support dual vector. 

Proof. Consider any ip G (R+)', i.e., (y,ip) > for all y > 0. Show ip can be 
represented by a finite support linear functional. 

Claim 1. There exists M G N such that for all v G M 1 ^ whose first M 
components are zero, (v, ip) = 0. 



Proof. Suppose no such M exists. Then for every n G N, there exists v n G 
such that (v n ,ip) > (we can assume strictly greater than zero without loss) 
and the first n components of v n are zero. Consider the sequence of vectors 
v n = , v Z , c for n G N. Observe that (v n , ip) — 1 for all n E N. Now, consider 

vector a G M+ where o(i) = ^ neN £ n (i) = Y?n=iV n (i) + Zln>i^ n (0 for a11 
i G N. Since t> n (i) = for all n > i, s Zj n>i v n {i) = 0. This implies J2n€N v n (i) 
is a finite sum and therefore well-defined. Given any N G N, it follows from 
the definition of a(i), that a(i) - £] n=1 n («) = S n6N # n («) ~ Zl„.=i^"(0 = 
J2 n>N v n (i). However, J2 n >N^ n ^) — ® srnce the v n are in R+. This implies 
a — J2 n =i v n > 0- Thus, (a — ^2 n=1 v n , ip) > for every iVEN. By linearity 
of ip, this implies that (a, ip) > ^2 n=1 (v n , ip) — N for every N EN. But this 
means (a, ip) cannot be a finite number, which is a contradiction of the fact 
that ip, being a linear functional, is real valued. □ 

Let M be the natural number from Claim [TJ Now let e % denote the element 
of R N with 1 in the z'-th coordinate and everywhere else. Let u G R^-* be 
a finite support element given as follows 



u(i) 



(e\ip), i<M 
0, i > M. 



Show that (y, ip) = ^2 ieN u(i)y(i) for every y G R . Observe that any y G 



N 



-M 



can be represented as y = ^2 i=1 ?/(«)e J + v where v has zeros in its first M 
components. By Claim [H (v,ip) = 0. Hence (y,ip) = X^i=i 2/(*)( e *5 ^) + 

(v,t/j) = J2ieN u ( i )y( i )- n 

A proof of a similar result appears as Theorem 16.3 in Aliprantis and 
Border [l|. Their result appeals to facts about Frechet lattices, Riesz spaces, 
and their proof is topological (based on continuity) in nature, as opposed to 
our proof technique which is purely algebraic. 

Using the above lemma Question [1] is answered for I = N. 



Theorem 2.2. When I = N, ^ flSTLPl) = t; (IDSILPp if and only if ^( ISTLTl) 
^ flFDSILPp . 



Proof. It suffices to show t'f TDSILP]) = v f ]FDSIL"P|) . Lemma 12.11 implies 
/tdNv ~ m>( N ) and thus the f eas ible regions of (IDSILPp and (IFDSILPp are 



equivalent under the standard embedding of R^ into (R N )'. The objectives 
are also equivalent under that embedding and thus v fIDSILPI) = f OFDSILP"]) . 

D 
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3. Duality gaps in proper subspaces of 



By Theorem I2.2[ the optimal value of the finite support dual is equal 
to the optimal value of the algebraic Lagrangian dual for semi-infinite lin- 
ear programs with countably many constraints, when we model them as an 
instance of (IConLPp using Y = M N . However, this is not necessarily true 
for problems with countably many constraints if they can be modeled as 
(IConLPj) with Fas a proper subspace of K N . In this section, we give an 
affirmative answer to Question [2] via Example 13.51 

Two examples of proper subspaces of M N are i^, the space of all bounded 
real sequences, and c, the space of all convergent sequences. Clearly, c C 
^oo C K N . We extend the notion of positive linear functionals to these sub- 
spaces. A linear functional ip G X' on any subspace X C M N , is called a 
positive linear functional on X if (v, ip) > for all v G IR+ fl X. 

Lemma 3.1. Define a positive linear functional ip on c by (v, ip) = lim^oo v (i) 
Then: 1) ip cannot be extended to a positive linear functional on M N , i.e., 
it cannot be extended to an element of (Rv.)' C (M N ) / , and 2) ip cannot be 
extended to a linear functional on IR N that can be represented by a sequence 
in M N with finite support. 

Proof. Show 1): assume ip is an extension of ip and that ip is a positive 
linear functional on R N . Derive a contradiction. Let 1 G K+ fl c be the all 
ones sequence. Then (l,ip) = (l,^) = !• Let v = (n) neN be the sequence 
(1,2,3,...). Since v is in the nonnegative orthant (v,ip) = a > 0. Let 
M = \a] + 1. Consider the sequence m = (0, 0, 0, ..., M, M, M, . . .) where 
the first M — 1 entries are 0. Then v — m is in the nonnegative orthant, 
but (v — m,ip) = (v, ip) — (m, ip) = a — (m, ip) = a — M < 0, and this 
is a contradiction to the assumption that ip is a positive linear functional. 
Therefore ip cannot be extended to a positive linear functional on M N . 

Show 2): assume ip is an extension of ip and that ip can be represented 
by a sequence in M N with finite support. Derive a contradiction. Clearly 
ip cannot be the zero element since (l,ip) = (l,^) = 1- If ip is nonzero, 
there is a nonzero index i G N for each element of the finite support of the 
sequence representing ip. Consider e l G M+. Then (e\ ip) = for each i, but 
(e\ ip) j^ for at least one % which contradicts the fact that ip is an extension 
of ip. Therefore ip cannot be extended to a linear functional on M N that can 
be represented by a sequence in M N with finite support. □ 



Although positive linear functionals on the space c cannot be extended 
to (Mv.)', they can be extended to positive linear functionals on i^ as shown 
in Lemma 13.31 below. 

First, recall the notion of a core point. Given a vector space X and a 
subset ACJ,a point a G A is called a core point of A if for every x G X, 
there exists e > such that a + Xx G A for all < A < e. Some authors 
call such a point an absorbing point or an internal point (see for instance 
Chapter 5 of Aliprantis and Border |l[ ) . The following is a useful result for 
extending positive linear functionals. 



Theorem 3.2 (Krein-Rutman theorem, see Holmes [4] p. 20). Let X be 
a vector space ordered by ^p where P is a pointed, convex cone in X. 
Furthermore, let M be a linear subspace of X ordered by bprw- If P fl M 
contains a core point (with respect to X) of P, then any positive linear 
functional on M admits a positive linear extension to all of X. In other 
words, if ip : M — > K. satisfies (m, ■0) > for all m G MflP, then there exists 
a ip : X — y K. with (x, '0) > for all x G P and (x, ?/>) = (x, ?/>) for all x G M. 

Lemma 3.3. Every positive linear functional on c can be extended to a 
positive linear functional on C.^. 

Proof. Let P = R^ fl^oo be the nonnegative cone in 0,^. Take the convergent 
sequence 1 = (1,1,...). This convergent sequence is an element of P fl c. 
Also, 1 is a core point of P with respect to t^. To see that 1 is a core 
point of P, take any {a n } n€ ^ G ioo. Since {a n } is in i^, sup n {|a n |} < oo and 
1 + \{a n } G P for all A G (0, l/sup n {|a n |}). Since P has a core point with 
respect to i^, apply the Krein-Rutman theorem to extend positive linear 
functionals defined on c to positive linear functionals defined on i^. □ 

Corollary 3.4. The limit functional defined in Lemma [3.11 can be extended 
to a positive linear functional over i,^. 

Example 13.51 below provides an affirmative answer to Question [2j This 



example gives an fISILPp with I = N, where ^ (ISILPp = ^( |DSILP(V)| and 
7; (jSTLT]) > f flFDSILPI) = ?; (1DSILPI) . with the subspace V = c and V = 4o- 



The equality ?; (1FDSILPI) = i; (1DSILPD follows from Theorem E2 
Example 3.5. The flSTLTj) is 

inf xi 

xi + ix 2 > |, i G N. 



(3.1) 



Show that (xi, x 2 ) = (4, 5) is feasible to (13.1 ft for all <5 > 0. For every z G N, 



(i - 5f 


> o 


i 2 + 5 2 - 25i 


> o 


t 2 + 5 2 


> 25i 


i 2 +S 2 
Si 2 

I + A 

<5 ^ i 2 


\ 26i 

> ?. 

— i 



Letting 5 — > oo gives a sequence of feasible solutions whose objective values 
converge to an objective value of 0. 

Next show that if (xi,x 2 ) is any feasible solution, then x\ > 0. The 
constraint corresponding to i = \\x 2 \] gives X\ > j^ - jj§^ > j^ > 0. 
Therefore the optimal primal objective value is equal to 0. 

The finite support dual (IFDSILPp for this semi-infinite linear program 
is infeasible. The objective coefficient of x 2 is and the coefficient of x 2 
is strictly positive in the constraints, and so the only possible dual element 
satisfying the dual constraint corresponding to Xi is u = 0; however, the 
objective coefficient of x\ is 1 and the dual constraint corresponding to X\ is 
not satisfied for u = 0. This shows that using the finite support dual leads 
to an infinite duality gap. 

In this example, a}(i) = 1 for all % £ N so this sequence converges to 1. 
Also, a 2 {i) = 4 for all i G N and this sequence converges to 0. Likewise, 
b(i) = 2 for all i e N so this sequence converges to 0. Therefore, this semi- 
infinite linear program is an instance of (IConLPI) with Y = c (or i^) C M N . 



Now consider the algebraic Lagrangian dual (DSILP(V) ) defined on the space 
of positive linear functionals on c (or (, 00 ). The limit functional if) defined 
in Lemma [3.11 is (v,ip) = limi_ >00 'z;(i), for all v G M^ fl c. This is a positive 
linear functional on c (as is its extension to £oo by Corollary I3.4[) since any 
convergent sequence of nonnegative numbers is nonnegative. As observed 
earlier, a}{i) converges to 1 which is the coefficient of x\ in the objective, and 
a 2 (i) converges to which is the coefficient of x 2 in the objective. Therefore 
if) is a feasible dual solution. The dual objective value (b, if)) is lim iG N b(i) = 
linijgN 2 = 0. This is the optimal value of the primal and therefore the duality 
gap is zero. 

This example illustrates part 1) of Lemma 13.11 If if) could be extended 
to a positive linear functional if) on M N , then if) would be a feasible solution 
to ( 1DSILPI) with objective function value zero implying a zero duality gap be- 
tween (13. ip and (IDSILPj) . Since there is an infinite duality gap between (13. ip 



and its finite support dual (IFDSILPp . this would contradict Theorem 12.21 < 
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